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0 A multi-point conference system for making a 
video conference includes a center unit (2) having a 
controller (46) and an image selector (42), and ttiree 
or more stations (1) respectively coupled to the 
center unit, where each station includes at least one 
camera (11-13) for picking up an image to output an 
image data, a display (14. 15) for displaying an 
image based on an image data and a request part 
(18) for making a request. The controller initially sets 
master, sub and participating stations in confor- 
mance with a predetermined rule. The image selec- 
tor automatically supplies the image data from the 
master station to the sub and participating stations to 
be displayed on the display thereof and supplies the 
image data from the sub station to the master station 
to be displayed on the display thereof. The controller 
automatically sets a new master station in response 
to a request from the request part of an arbitrary 
station requesting the new master station, sets the 
master station prior to receiving the request as a 
new sub station and sets all stations other than the 
new master and sub stations as new participating 
stations. 
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@ AAulU-poInt conference system, 

@ A multi-point conference system for making a 
video conference Includes a center unit (2) iiaving a 
controller (46) and an Image selector (42), and three 
or more stations (1) respectively coupled to the 
center unit, where each station includes at least one 
camera (11-13) for picking up an image to output an 
image data, a display (14, 15) for displaying an 
Image based on an image data and a request part 
(18) for making a request The controller initially sets 
master, sub and participating stations In confor- 
mance with a predetermined rule. The image selec- 
f^Xor automatically supplies the image data from the 
^master station to the sub and participating stations to 
be displayed on the display thereof and supplies the 
S9 image data from the sub station to the master station 
<£)to be displayed on the display thereof. The controller 
-^automatlcaliy sets a new master station in response 
§to a request from the request part of an arbitrary 
"^station requesting the new master station, sets the 
Q master station prior to receiving the request as a 
new sub station and sets all stations other than the 
0-new master and sub stations as new participating 
stations. 
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MULTI-POINT CONFERENCE SYSTEM 



BACKGROUND OF THE INVENTION 

The present Invention generally relates to 
multi-point conference systems, and more particu- 
larly to a multi-point conference system which en- 
ables a video conference to be made simulta- 
neously among three or more stations. 

A video conference is made among distant 
locations In order to quickly transmit information 
and to reduce both time and cost of business trips 
and of moving objects. Presently, a conference 
(communication) is made between two stations on 
a point-to-point basis as shown in FIG.1. Each 
station, that is. each conference room, includes a 
panoramic camera 11 for picking up a panoramic 
view of the conference room, a close-up camera 12 
for picking up a person (for example, a speaker), a 
camera 13 for picking up a material used in the 
conference, a monitor 14 for displaying a received 
Image, a monitor 15 for displaying a transmitting 
image, a microphone 16. a speaker 17 and a 
console 18 which are all connected to a conference 
control unit 20, 

The conference control unit 20 controls the 
Input/output of input Image data from the cameras 
11 through 13 and output image data to the moni- 
tors 14 and 15. The conference control unit 20 also 
controls the coding/decoding of the image data and 
the audio data. and controls the 
multiplexing/demultiplexing of the Image and audio 
data The control operation of the conference con- 
trol unit 20 realizes an interactive conference be- 
tween two stations. However, there are demands to 
realize a multi-point conference system which en- 
ables a conference among three or more stations. 

As a multi-point conference system which en- 
ables a conference among three or more stations, 
there is a conventional system shown in FIG.2 In 
which a circuit is connected to all of stations 10. 
However, as the number of stations 10 Increases, 
the number of circuits also increases. When the 
number of stations 10 is denoted by n, the number 
of circuits becomes Ei, where i = 1, 2, .... n-1. As 
a result, each station 10 must have the conference 
control unit 20 shown in FIG.1 with a number of 
coder/decoder parts corresponding to the number 
of stations 10 connected thereto. 

On the other hand, it is conceivable to connect 
the circuits in a star connection by use of a center 
unit 30 as shown in FIG.3. In this case, the center 
unit 30 selectively distributes the Image data to the 
stations 10. But In this case, the center unit 30 
must switch the image data depending on control 
signals which are received from each of the sta- 
tions 10. As a result, there is a problem In that the 



required Image data must be manually requested 
from each of the stations 10, and it is difficult to 
smoothly and efficiently make the video confer- 
ence. 

5 

SUMMARY OF THE INVENTION 

Accordingly, it Is a general object of the 
70 present invention to provide a novel and useful 
multi-point conference system in which the prob- 
lems described above are eliminated. 

Another and more specific object of the 
present invention Is to provide a multi-point cen- 
ts ference system for making a video conference 
comprising a center unit including control means 
and image selector means, and three or more 
stations respectively coupled to the center unit, 
where each station includes at least one camera for 
20 picking up an image to output an image data, 
display means for displaying an image based on 
an Image data and request means for making a 
request. The control means initially sets master, 
sub and participating stations in conformance with 
25 a predetermined rule. The Image selector means 
automatically supplies the Image data from the 
master station to the sub and participating stations 
to be displayed on the display means thereof and 
supplies the image data from the sub station to the 
30 master station to be displayed on the display 
means thereof. The control means automatically 
sets a new master station In response to a request 
from the request means of an arbitrary station 
requesting the new master station, sets the master 
35 station prior to receiving the request as a new sub 
station and sets all stations other than the new 
master and sub stations as new participating sta- 
tions. According to the multi-point conference sys- 
tem of the present invention, it is possible to 
40 smoothly make a video conference among three or 
more stations. 

Still another object of the present invention is 
to provide a multi-point conference system for 
making a video conference comprising a plurality 
45 of center units, where each center unit Includes 
control means and image selector means, a plural- 
ity of stations respectively coupled to each of the 
center units, where each station includes at least 
one camera for picking up an image to output an 
50 image data, display means for displaying an image 
based on an image data and request means for 
making a request, and circuits which couple the 
center units in a tandem connection. The control 
means Initially sets master, sub and participating 
stations in conformance with a predetermined rule. 
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The image selector means automatically supplies 
the image data from the master station to the sub 
and participating stations to be displayed on the 
display means thereof and supplies the rmage data 
from the sub station to the master station to be 
displayed on the display means thereof. The con- 
trol means automatically sets a new master station 
In response to a first request from the request 
means of an arbitrary station requesting the new 
master station, sets the master station prior to 
receiving the first request as a new sub station and 
sets all stations other than the new master and sub 
stations as new participating stations. According to 
the multi-point conference system of the present 
invention, it is possible to improve the degree of 
freedom with which the scale of the conference 
system can be expanded. In addition, it is possible 
to suppress the cost of circuits even when the 
video conference is to be made among distant 
stations. 

Other objects and further features of the 
present invention will be apparent from the follow- 
ing detailed description when read In conjunction 
.with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.1 is a system block diagram showing a 
conventional conference system which enables a 
video conference between two stations; 

FIG.2 is a system block diagram showing a 
conventional multi-point conference system which 
enables a video conference among three or more 
stations; 

FIG.3 is a system block diagram showing a 
conceivable multi-point conference system which 
enables a video conference among three or more 

stations; 

FIG.4 Is a system block diagram showing a 
first embodiment of a multi-point conference sys- 
tem according to the present Invention; 

F1G.5 is a diagram for explaining a switching 
of image data during a multi-point conference; 

F1G.6 is a diagram for explaining a switching 
. including camera gontrol during the multi-point con- 
ference; 

FIG.7 is a system block diagram showing an 
embodiment of a center unit shown In FiG.4; 

FIG.8 is a system block diagram for explain- 
ing a video conference made among three distant 
regions; 

RG.9 is a system block diagram showing a 
second embodiment of the multi-point conference 
system according to the present invention; 

FIG.1 0 is a system block diagram showing 
an embodiment of the center unit shown in FIG.9; 

FIG.1 1 Is a diagram for explaining an opera- 



tion of the second embodiment; and 

FIG.1 2 is a flow chart for explaining an Initial 
setting operation of a controller of the second em- 
bodiment 

5 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

First, a description will be given of a first em- 

70 bodiment of a multi-point conference system ac- 
cording to the present invention, by referring to 
FIG.4. In this embodiment, it is assumed for the 
sake of convenience that a video conference is to 
be made among four conference rooms, that is, 

75 four stations 1A through ID. 

In FIG.4, tiie four stations 1A through ID are 
coupled to a center unit 2. Each of tiie stations 1A 
through ID respectively have cameras 11 through 
13, a monitor 14 and tine like similarly to the 

20 conference control unit 20 shown in FIG.1 . Only the 
cameras 11 and 13 and the monitor 14 are shown 
to simplify the drawing. In this embodiment, one of 
the names "master station", "sub station" and 
"participating station" is automatically assigned to 

25 each of the stations 1A through ID depending on 
the course of the video conference, and each of 
the stations 1A tiirough ID automatically switch 
and display an Image from one of the three otiier 
stations. 

30 A description will now be given of the switching 
transition of the Image displayed on each monitor 
14 of the stations 1A tiirough ID, by refemng to 
FIG.5. In FIG.5 and FIG.6 which will be described 
later, a rectangular symbol indicates the station 

35 from which the displayed image is received, "A" 
tiirough "D" respectively denote the stations 1A 
through ID, and "PARTI" Indicates "participating" 
station. 

At the start of the video conference, the station 

40 1A which assumes the conference state first is 
regarded as a master station. A station assumes 
tiie conference state when the units making up the 
station are turned ON, the necessary circuit con- 
nection is made and the like. The station IB which 

45 assumes the conference state second is regarded 
as a sub station. The stations 1C and ID which 
assume the conference state tiiereafter are regard- 
ed as participating stations. As shown in FIG.5(1), 
the master station displays the image data from the 

60 sub station on the monitor 14 while tiie sub and 
participating stations display tiie image data from 
the master station on the respective monitors 14. In 
other words, only the image data from two stations 
are displayed at one time during the video con- 

55 ference as a whole. 

After the start of the video conference, when 
control data which newly selects the station 10 is 
received from the sub or participating station (for 
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example. IB or ID), the center unit 2 assumes that 
the newly selected station 1C has become the 
center of the video conference and regands the 
station 1C as a master station. The station from 
which the image data displayed on the monitor 14 
of the station 1C Is obtained before the center unit 
2 receives the control data, that Is, the station 1A, 
is then regarded as a sub station and the stations 
1B and 1D which are other than the master and 
sub stations are regarded as participating stations. 
Similarly as described above, the Image data from 
the master station 1C is displayed on the respec- 
tive monitors 14 of the sub and participating sta- 
tions 1A. IB and ID while the image data from the 
sub station 1A is displayed on the monitor 14 of 
the master station 1C as shown in FIG.5{2). When 
control data which newly selects the station IB is 
received from the master station 1C, the center unit 
2 regards the newly selected station IB as a sub 
station and the monitor 14 of the master station 1C 
is switched to thereafter display the image data 
from the sub station 18, while the center unit 2 
regards the station 1A as a participating station as 
shown in FIG.5(3). The master and participating 
stations 1C and ID remain unchanged in this case. 

When the participating station 1D no longer 
needs to participate in the video conference and 
disconnects, there is no change in the assignment 
of the master, sub and participating stations as 
shown in FIG.5(4). On the other hand, when the 
station ID needs to participate during the video 
conference and connects, the center unit 2 merely 
regards the newly connected station 1D as a par- 
ticipating station, and the assignment of the master, 
sub and participating stations remains unchanged 
as shown In F1G.5(5). 

When the sub station IB no longer needs to 
participate in the video conference and discon- 
nects, the center unit 2 forcibly sets an arbitrary 
participating station 1 A as a sub station as shown 
In FIG.5(6). On the other hand, when the station IB 
needs to participate during the video conference 
and connects, the center unit 2 merely regards the 
newly connected station IB as a participating sta- 
tion, and the assignment of the master, sub and 
participating stations remains unchanged as shown 
in F1G.5{7). 

When the master station 10 no longer needs to 
participate In the video conference and discon- 
nects, the center unit 2 forcibly sets the sub station 
1A as a master station and forcibly sets an ar- 
bitrary participating station IB as a sub station as 
shown in RQ.5(8). On the other hand, when the 
station 10 needs to participate during the video 
conference and connects, the center unit 2 merely 
regards the newly connected station 10 as a par- 
ticipating station, and the assignment of the master, 
sub and participating stations remains unchanged 



as shown in FIQ.5(9). 

Of course, It Is possible to take measures so 
that an arbitrary station designated from the master 
station becomes a new master station. In this case. 
5 the old master station becomes a new sub station, 
and the old sub station becomes a new participat- 
ing station. 

Next, a description will be given of the camera 
control, by refemng to FIG.6. The camera control 

10 includes moving the cameras 11 through 13 and 
switching the cameras 11 through 13 to pickup the 
person, the panoramic view or the material. In 
F1G.6. "ALL" indicates the panoramic view, "P" 
indicates the person, and "M" indicates the ma- 

15 terial which are displayed. 

The camera control may be divided into two 
kinds of control. According to one kind of camera 
control, the station controls the cameras 11. 12 and 

13 thereof. According to another kind of camera 
20 control, one station controls the cameras 11 

through 13 of another station from which the dis- 
played image data on the monitor 14 is received. In 
other words, the master station may control the 
cameras of the sub station, and the sub or partici- 
25 pating station may control the cameras of the mas- 
ter station. 

With regard to the control of the cameras of 
the master station, the priority of the control is 
given to the sub or participating station which re- 
30 quests the control first. F1G.6(1) shows an initial 
state of the camera control. When the sub station 
IB requests the display of the person, the monitors 

14 of the sub and participating stations IB, 10 and 
ID all display the person picked up by the camera 

35 12 of the master station 1A as shown in FIG.6(2). In 
this state, the monitor 14 of the master station 1A 
displays the panoramic view picked up by the 
camera 11 of the sub station 1B. When the master 
station 1A requests the display of the person, the 

40 monitor 14 of the master station 1A displays the 
person which Is picked up on the camera 12 of the 
sub station IB while the monitors 14 of the sub and 
participating stations IB. 10 and 1D all remain 
unchanged and display the person picked up by 

4B the camera 12 of the master station 1A as shown in 
FIG.6{3). When the participating station 10 re- 
quests the display of the panoramic view, the mon- 
itor 14 of the master station 1A remains unchanged 
and displays the person which is picked up on the 

.60 camera 12 of the sub station IB while the monitors 
14 of the sub and participating stations 1B, 10 and 
ID all change and display tlie panoramic view 
picked up by the camera 11 of the master station 
1A as shown in F1G.6(4). 

55 When the station controls the cameras thereof, 
the camera control becomes as shown in FIGS.6(5) 
through 6(7). In other words, when the master 
station 1A controls the camera 12 thereof to pickup 
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a certain person, the image data displayed on the 
monitor 14 of the master station 1A remains un- 
changed- but the image data displayed on the sub 
and participating stations IB through 1D changes 
as shown in FIG.6(5). When the sub station 1B 
controls the camera 12 thereof to pickup a certain 
person, the Image data displayed on the monitor 
14 of the master station 1A changes but the Image 
data displayed on the sub and participating stations 
IB through ID remains unchanged as shown in 
FIG.6(6). On the other hand, when the participating 
station 1C or ID controls the camera 12 thereof to 
pici<up a certain person, the image data displayed 
on the monitors 14 of the master, sub and partici- 
pating stations 1A through 1D all remain un- 
changed as shown in FIG.6(7). 

When using the camera 13 to pickup the ma- 
terial, the operator must perfomi an operation of 
preparing, selecting and setting the material. For 
this reason, each station controls the camera 13 
thereof. Normally, when selecting the material 
which is to be picked up by the camera 13, the 
video conference Is usually to progress by use of 
the material, that is. while watching the material. 
Hence, when the camera 13 is selected at an 
arbitrary station to pick up the material, the center 
unit 2 regards this arbitrary station as the master 
station as shown in. FIGS.6(8) and 6(9). In the case 
shown In FIG.6(8). when the participating station 1C 
selects the camera 13 to pick up the material, the 
center unit 2 regards the station 1C as the new 
master station and regards the station 1A which 
was the master station before the selection of the 
camera 13 In the station 1C as the new sub station. 
In addition, the center unit 2 regards the station IB 
which was the sub station before the selection of 
the camera 13 In the station 1C as the new partici- 
pating station, while the participating station ID 
remains unchanged. On the other hands, in the 
case shown in FIG.6(9). when the sub station 1A 
selects the camera 13 to pick up the material, and 
the center unit 2 regards the station 1 A as the new 
master station and regards the station 1C which 
was the master station before the selection of the 
camera 13 in the station 1 A as the new sub station. 
In addition, the participating stations IB and ID 
remain unchanged. 

Therefore, the switching of the image data Is 
automatically controlled by the center unit 2 de- 
pending on the control data received from the 
stations 1A through ID. As a result, the video 
conference can be made smoothly and efficiently, 
and the course of the video conference can be 
unified. 

Next, a description will be given of an embodi- 
ment of the center unit 2 shown in FIG.4, by 
referring to FIG.7. The center unit 2 Includes line 
control units 41, an image selector 42, audio 



coder/decoder parts 43. interfaces 44, an audio 
mixer 45 and a controller 46. 

The number of line control units 41 Is equal to 
the number of stations to which the center unit 2 is 
6 connected. In this embodiment, there are four line 
control units 41 . The line control unit 41 is made 
up of a circuit interface 41a. a multiplexer 41b and 
a demultiplexer 41c which are connected as 
shown. The Image selector 42 selectively supplies 
10 an image signal from the demultiplexer 41c of one 
line control unit 41 to the multiplexer 41b of an- 
other line control unit 41 . 

The audio coder/decoder part 43 Is provided 
with respect to each line control unit 41. The audio 
75 coder/decoder part 43 decodes audio data from the 
demultiplexer 41c of the corresponding line control 
unit 41 and also codes audio data which is sup- 
plied to the multiplexer 41b of the con^esponding 
line control unit 41. 
20 The interface 44 is also provided with respect, 

to each line control unit 41. The Interface 44 re- 
ceives low-speed control data from the demul- 
tiplexer 41c of the corresponding line control unit 
41 and also supplies control data to the multiplexer 
25 41 b of the corresponding line control unit 41 . 

The audio mixer 45 mixes the audio data re- 
ceived from each of the stations via each of the 
audio coder/decoder parts 43 and supplies a com- 
mon mixed audio data to each of the audio coder 
30 decoder parts 43. 

The controller 46 controls the selection of the 
Image selector 42 and also control the audio mixer 
45 based on the control data from the Interfaces 
44. The controller 46 also supplies control data to 
35 each of the stations via the interfaces 44. In other 
words, the controller 46 prestores a software for 
canrying out the control algoritiims described In 
conjunction with F1GS.5 and 6. 

For the sake of convenience, it is assumed that 
40 each station has the stnjcture including the con- 
ference control unit 20 and the elements connected 
thereto as shown In F1Q.1. In F1G.7. each line 
control unit 41 receives input/output image control 
data which is received from the console 1 8 via the 
46 conference control unit 20 of the corresponding 
station. The demultiplexer 41c of the line control 
unit 41 demultiplexes the input/output image con- 
trol data and supplies the data to the controller 46 
via the interface 44. The controller 46 discriminates 
50 which Image data from the stations is to be dis- 
played on the monitors 14 of the stations and 
which cameras are to be used in the stations based 
on the control algorithms described above. The 
controller 46 controls the Image selector 42 de- 
55 pending on the above discrimination, so that the 
image data from a station is supplied to and dis- 
played on the monitor 14 of another station. In 
addition, the controller 46 supplies the control data 
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for selecting the camera and the monitor to eacii 
station via the interface 44. Under the control of the 
controller 46, the audio mixer 45 mixes the audio 
data from the microphones 16 of each of the sta- 
tions and supplies the mixed audio data to the 
speakers 17 of each of the stations, so that at one 
station the speaker 17 outputs frie voices from 
each of the stations except the voice picked up 
within the same station. 

The center unit 2 automatically controls the 
switching of the Image data based on the control 
data from each of the stations. For this reason, the 
multi-point video conference can be carried out 
substantially as If the video conference were made 
at one location and the course of the video con- 
ference is extremely smooth because the image 
data to and from each station are switched auto- 
matically. 

A method of automatically detecting the speak- 
er during the video conference and controlling the 
camera depending on the detection is proposed in 
Japanese Laid-Open Patent Applications No^- 
52581 and No.2-52582. According to this proposed 
method, the audio data from the microphones In 
each of the stations are supervised and the speak- 
er Is detected when the audio data from the micro- 
phone of one station continues for a predetermined 
time. When the speaker is detected, the camera is 
moved to pick up the speaker who is speaking to 
the microphone in the state. 

The above proposed method is also applicable 
to the first embodiment That Is. the center unit 2 
can switch the image data from the stations de- 
pending on the speaker detection data from one of 
the stations, and regards one station as the master 
station when the speaker detection data is received 
from this one station. Therefore, the speaker detec- 
tion data may be treated simiiarly to the control 
data when automatically switching the image data, 
and the course of the video conference becomes 
even smoother. 

When the control data supplied to the center 
unit 2 includes the speaker detection data, it is 
desirable to treat the control data manually input 
from the console 18 of the station with a priority 
over the speaker detection data. For example, the 
manual control data from one station may indicate 
that this station is to be regarded as the master 
station. Furthermore, the manual control data from 
the master station may indicate which station is to 
be regarded as the sub station. In such cases, the 
center unit 2 controls the switching of the image 
data based on the manual control data by disregar- 
ding the speaker detection data. 

In addition, the image data displayed on the 
monitor 14 of one station is not limited to the 
image from one camera within another station. For 
example, the monitor 14 of one station may si- 



multaneously display the Images picked up by the 
cameras 12 and 13 of another station. When the 
master station 1A selects the camera 13 and the 
image data from the camera 12 of the sub station 
5 1C is received in a case shown in FIG.6(9). the 
monitor 14 of the master station 1A simultaneously 
displays the images from the cameras 12 and 13 of 
the sub station 1C. 

When the Image data from the camera 12 of 
10 the master station 1C is displayed on the monitor 
14 of the sub station 1A in a case shown in FIG.6- 
(8). it Is also possible to switch the display within 
the master station 1C so that the monitor 14 of the 
master station 1C displays the image data from the 
75 camera 13 thereof. 

According to this embodiment, the center unit 
assigns the names "master station", "sub station" 
and participating station" to each of the stations, 
and automatically controls the switching of the im- 
20 age data to and from each of the stations based on 
the control data which are received from the sta- 
tions. The switching of the Image data is made by 
selecting the appropriate cameras. Therefore, the 
video conference can be made smoothly and effi- 
26 ciently, and the course of the video conference can 
be unified similarly as in the case of a video 
conference between two stations. 

On the other hand, when the video conference 
is to take place among three mutually distant re- 
30 gions 71 through 73 as shown in F1G.8, for exam- 
ple, each station 1 within one of the regions 71 
through 73 must be coupled to the center unit 2 via 
a corresponding one of circuits 74-1 through 74-3. 
The center unit 2 assigns the master, sub and 
35 participating stations depending on the control data 
from each of the stations 1 which are involved in 
the video conference. 

However, as the number of stations which are 
to participate in the video conference increases 
40 and the stations are provided within a plurality of 
regions, a large number of circuits is required to 
couple each station to the center unit, and each 
circuit which couples one station to the center unit 
is long when the regions are distant from each 
45 other. For this reason, there is a problem in that the 
cost of the required circuits becomes high when 
enabling the video conference among three or 
more stations located within mutually distant re- 
gions. 

50 Furthermore, the scale of the center unit be- 
comes extremely large as the number of stations 
connectable thereto increases. On the other hand, 
when a maximum number of connectable stations 
are coupled to the center unit, there is a problem in 

55 that an additional station cannot be newly coupled 
to the center unit and the multi-point conference 
system has no freedom of system expansion. 

Accordingly, a description will now be given of . 



6 



11 



EP 0 400 668 A2 



12 



a second embodiment of the multi-point conference 
system according to the present Invention In which 
the above noted problems are overcome. FIG.9 
shows the second embodiment. 

In FIG.9, a plurality of stations 1 are connected 
to each center unit 2, and a plurality of such center 
units 2 are coupled via circuits 3. Each center unit 
2 assigns the names "master station", "sub sta- 
tion" and "participating station" to each of the 
stations 1 connected thereto similarly to the first 
embodiment. And in this second embodiment, the 
center units 2 are coupled in tandem via the cir- 
cuits 3, so that an arbitrary number of stations 1 
may participate in a video conference. 

The center unit 2 which is connected to the 
master station 1 is regarded as a master center 
unit, and the center unit 2 which is connected to 
the sub station 1 is regarded as a sub center unit. 
The master center unit 2 supplies the image data 
from the master station 1 to the center units 2 
which are connected to the stations 1 other than 
the master station 1. On the other hand, the sub 
center unit 2 supplies the image data from the sub 
station 1 to the master center unit 2. 

Initially when the center units 2 are connected 
In tandem using the circuits 3, addresses assigned 
to the center units 2 are transmitted and received 
among the center units 2. The center unit 2 having 
a minimum address is regarded as a master center 
unit which is connected to the master station, and 
the center unit 2 having a minimum address ex- 
cluding the address of the master center unit Is 
regarded as a sub center unit which is connected 
to the sub station. 

Each center unit 2 is connected to an arbitrary 
number of stations 1. Hence, by connecting the 
center units 2 in tandem using the circuits 3. the 
number of stations 1 which can participate in the 
video conference can be increased arbitrarily in 
correspondence with the number of center units 2 
which are coupled via the circuits 3. in other words, 
the degree of freedom with which the multi-point 
conference system can be expanded is greatly 
Improved in .this embodiment. In addition, since 
only one circuit 3 is required to coupled two center 
units 2. it is possible to suppress the increase in 
expansion cost even when the distance between 
the two center units 2 is long. 

In addition, when assigning the master, sub 
and participating stations at the start of the video 
conference, an initial setting is made and the trans- 
mission and reception of the Image data among the 
center units 2 are controlled In each center unit 2. 
The initial setting includes comparing the address- 
es which are assigned to each of the center units 2 
beforehand. By this initial setting, the center unit 2 
having a minimum address is regarded as a master 
center unit which is connected to the master sta- 



tion, the center unit 2 having a minimum address 
excluding the address of the master center unit is 
regarded as a sub center unit which is connected 
to tiie sub station, and each of the other center 
5 units 2 are regarded as a participating center unit 
which is connected only to the participating station. 

FiG.10 shows an embodiment of the center unit 
2 shown In FIG.9. In FIG.10. those parts which are 
essentially the same as those conresponding parts 
10 in FIG.7 are designated by the same reference 
numerals, and a description thereof will be omitted. 
The circuit interface 41a of each line control unit 41 
is connected to a corresponding one of circuits 48- 
1 through 48-4. 
15 The circuits 48-1 and 48-4 couple the center 

unit 2 shown in FIG.10 in tandem to other center 
units 2 which are not shown in FIG.10. On the other . 
hand, the circuits 48-2 and 48-3 connect the center 
unit 2 shown in RG.10 to the stations 1 which are 
20 not shown in FIG.10. In this embodiment, it Is 
assumed for the sake of convenience that two 
stations 1 can be connected to the center unit 2 
shown In FIG.10, but It is of course possible to 
. connect more than two stations 1 to the center unit 
25 2. In addition, the center unit 2 which is located at 
each end of the tandem connection only requires 
one of the circuits 48-1 and 48-4. 

The image and audio data are processed simi- 
larly as In the first embodiment. The master, sub 
30 and participating stations are assigned to each of 
the stations 1 which participate in the video con- 
ference. In addition, the assignment of the master, 
sub and participating stations Is appropriately 
changed depending on the control data from the 
35 stations 1. As described above, the center unit 2 
which Is connected to the master station 1 is re- 
garded as the master center unit. 

The controller 46 controls the image selector 
42 In each center unit 2 so that the Image data 
40 from the master station 1 is transmitted to the sub 
and participating stations 1 and the image data 
from the sub station 1 Is transmitted to the master 
station 1. Accordingly, the master center unit 2 
transmits the image data to other center units 2, 
45 and the sub center unit 2 which is connected to the 
sub station 1 transmits the image data to the mas- 
ter center unit 2. 

For example, when the station 1 which is coup- 
led to the center unit 2 via the circuit 48-2 be- 
so comes a master station, the image data from the 
master station 1 Is supplied to the multiplexer 41b 
via the circuit interface 41a. After the Image data is 
separated from the audio and control data, the 
image data Is supplied to the image selector 42 
65 which Is controlled by the controller 46 so that the 
image data Is transmitted to the other circuits 48-1, 
48-3 and 48-4. The Image selector 42 is controlled 
by the controller 46 so that the Image data from 
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the sub station 1 is transmitted to the circuit 48-2. 

Therefore, at an arbitrary station l.it is possi- 
ble to listen to the audio data from all other stations 
1. In addition, the image data from the sub station 
1 Is displayed in the master station 1 while the 
image data from the master station 1 is displayed 
in the sub and participating stations 1, When the 
sub or participating station 1 Is regarded as a new 
master station in response to the control data 
(manual control data, speaker detection data and 
the like), the old master station 1 is regarded as a 
new sub station and the other stations 1 are all 
regarded as participating stations. When the image 
data from the participating station 1 is requested 
from tfie master station 1. this participating station 
1 Is regarded as a new sub station and the old sub 
station 1 Is regarded as a participating station. 
Such a control of the assignment of the master, 
sub and participating stations Is carried out by the 
controller 46. For example, the control data from 
the stations 1 are received by the circuit Interfaces 
41a via the circuits 48-2 and 48-3, and the mul- 
tiplexers 41b separate and supply the control data 
to the controller 46. The controller 46 uses flag 
setting parts 46A and 46B to display that a change 
is made In the assignment of the master, sub and 
participating stations. The controller 46 also man- 
ages information on which stations 1 are regarded 
as the master, sub and 1 participating stations. 
Furthermore, the controller 46 displays whether or 
not the center unit 2 Is a master center unit. 

Next, a description will be given of the opera- 
tion of this embodiment, by refenring to FIGS.11(a) 
through 11(f). 

RG.11{a) shows four center units 21, 22, 23 
and 24 which are connected in tandem via circuits 
25, 26 and 27. Addresses A3, A1 , A4 and A2 are 
respectively assigned to the center units 21 , 22. 23 
and 24, where A1 < A2 < A3 < A4. For example, 
the center unit 21 which Is located on one end of 
the tandem connection and only has one circuit 25 
connected thereto sends its own address A3 to the 
center unit 22 via the circuit 25 to make an Initial 
setting, as indicated on the upper part of FIG.11(b). 
The center unit 22 compares the received address 
A3 and its own address A1 , and sends the smaller 
address A1 to the center unit 23 via the circuit 26 
because A3 > A1. The center unit 23 compares the 
received address A1 and its own address A4, and 
sends the smaller address A1 to the center unit 24 
via the circuit 27 since A4 > A1. The center unit 24 
compares the received address A1 and its own 
address A2, and judges that the address A2 thereof 
Is not the minimum address because A2 > A1 . 

The center unit 24 is located at one end of the 
tandem connection and sends its own address A2 
to the center unit 23 via the circuit 27 as shown on 
the lower part of RQ.11(b). By making the trans- 



mission and reception of the addresses In the 
above described manner, the center unit 24 judges 
that It Is not a master center unit. This means that 
the master center unit is coupled on the side of the 

6 circuit 27, and the center unit 24 sets a value "1" 
on the left side of a master station direction flag as 
shown in FlG.11{c). The center unit 23 compares 
the address A2 received from the center unit 24 
and Its own address A4. and sends the smaller 

10 address A2 to the center unit 22 via the circuit 26 
because A4 > A2. At a time when the addresses 
are received from the center units 22 and 24 on 
both sides of the center unit 23. the center unit 23 
judges that the master center unit is coupled on 

T6 the side of the circuit 26 and not the circuit 27. 
Hence, the center unit 23 sets a value "1" on the 
left side of the master station direction flag as 
shown In FIG.11(c). 

The center unit 22 compares the address A2 

20 received from the center unit 23 and its own ad- 
dress A1, and judges that its address A1 is the 
minimum address since A1 < A2. Accordingly, the 
center unit 22 sets a value "1 " at the center of the 
master station direction flag as shown in FIG.11(c) 

25 to indicate that the center unit 22 is the master 
center unit. On the other hand, the center unit 22 
sends its own address A1 to the center unit 21 via 
the circuit 25. The center unit 21 compares the 
address A1 and its own address A3, and judges 

30 that the master center unit is coupled on the side 
of the circuit 25 because A3 > Al, Hence, the 
center unit 21 sets a value "1" on the right side of 
the master station direction flag as shown In 
FIG.Il(c). 

35 The master center unit 22 compares the ad- 
dresses A2 and A3 which are respectively received 
from the right and left thereof, and since A3 > A2, 
the master center unit 22 judges that a sub center 
unit which Is connected to the sub station 1 exists 

40 on the right side of the master center unit 22. 
Hence, the master center unit 22 sends a sub 
station designation status on the circuit 26 as 
shown In FlG.11(d). and sets a value "1" on the 
right side of a sub station direction flag as shown in 

45 FIG.II(e). The center unit 23 compares the ad- 
dress A2 of the sub station designation status and 
its own address A4, and sends the sub station 
designation status to the circuit 27 as it is because 
A4 > A2. The center unit 24 sets a value "1 " at the 

50 center of the sub station direction flag in response 
to the sub station designation status and to indicate 
that the center unit 24 is the sub center unit. The 
flag setting parts 46A and 468 of the controller 46 
are respectively used for storing the master and 

55 sub station direction flags. 

Next, as shown in FIG.11(f), the master center 
unit 22 sends a conference start status to the 
circuits 25 and 26. The center unit 23 relays the 
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conference start status and supplies the conference 
start status to the center unit 24 via the circuit 27. 
As a result, an initial setting Is made with respect 
to the master and sub center units 22 and 24 as 
shown in FIG.II(f). For example, when a station 31 
which is connected to the master center unit 22 is 
regarded as the master station and a station 35 
which Is connected to the sub center unit 24 Is 
regarded as the sub station, an image signal a from 
the master station 31 is transmitted to stations 28, 
29, 30 and 32 through 37 which are either the sub 
station or the participating station via the master 
center unit 22 and the other center units 21, 13 and 
24. On the other hand, an image signal b from the 
sub station 35 is transmitted from the sub center 
unit 24 to the master center unit 22 via the circuit 
27, the center unit 23 and the circuit 26, and the 
image signal b Is transmitted to the master station 
31 from the master center unit 22. 

FIG.12 is a flow chart for explaining the initial 
setting operation of the controller 46 described 
above. In FIG.12, a step SI discriminates whether 
or not a tandem connection is made by the start of 
the video conference. When the discrimination re- 
sult in the step SI Is NO, a step S2 makes a 1- 
center operation in which the video conference Is 
made among stations which are connected to a 
single center unit. 

On the other hand, when the discrimination 
result in the step SI Is YES. a step S3 discrimi- 
nates whetiier or not the center unit is located on 
one end of the tandem connection and has a circuit 
connected on only one side thereof as in the case 
of the center units 21 and 24 shown in FIG.11. 
When the discrimination result in the step S3 is 
YES, a step S4 sends out Its own address and a 
step S5 discriminates whether or not an address Is 
received from another center unit. When the dis- 
crimination result in the step S5 becomes YES, a 
step SB discriminates whether or not Hs own ad- 
dress is smaller than the address received from the 
other center unit. When the discrimination result in 
the step S6 is YES, a step S7 sets a value "1" at 
the center of the master station direction flag be- 
cause its own address Is minimum In this case. A 
step S8 sets the sub station direction flag which 
indicates the direction in which the sub center unit 
exists, and sends out the sub station designation 
status. A step S9 sends out the conference start 
status and the Initial setting ends. The process 
advances to a step SI 8 when the discrimination 
result in the step S6 is NO. 

When the discrimination result in the step S3 is 
NO, a step SIC discriminates whether or not an 
address is received from another center unit. When 
the discrimination result in the step S10 becomes 
YES. a step S11 discriminates whether or not its 
own address is smaller than the address received 



from the other center unit. When the discrimination 
result in the step S1 1 is YES, a step SI 2 sends out 
its own address. On the other hand, a step SI 3 
sends out the address received from the other 
6 center unit when the discrimination result in the 
step S11 Is NO. 

A step SI 4 discriminates whether or not the 
transmission and reception of addresses is com- 
pleted between the center units which are located 
10 on both ends of the tandem connection. When the 
address Is only received from the center unit which 
is located on one end of the tandem connection 
and the discrimination result in the step SI 4 is NO, 
the process returns to the step S10 so as to 
T5 receive the address from the center unit which is 
located on the other end of the tandem connection. 
When the discrimination result in the step S14 is 
YES, a step SI 5 compares its own address and the 
addresses received from the center units which are 
20 respectively located on the right and left thereof. 

When its own address is smaller than the ad- 
dresses received from the center units which are 
respectively located on the right and left thereof, 
the process advances to the step S7. In this case. 
25 its own address is the minimum, and tfius, a value 
"1" is set at the center of the master station 
direction flag to indicate that this center unit is the 
master center unit. Thereafter, the Initial setting 
ends after carrying out the steps S8 and SO. 
30 On the other hand, when Its own address is 
greater than the address received from the center 
unit located on the right thereof In the step SI 5. a 
step S16 sets a value "1" on the right side of the 
master station direction flag, and a step SI 8 dis- 
ss criminates whether the next received status is the 
sub station designation status or the conference 
start status. In the step SI 5. when its own address 
is greater than the address received from the cen- 
ter unit located on the left thereof, a step SI 7 sets 
40 a value "1 " on the left side of the master station 
direction flag, and the step SIB is carried out 

When the next received status is the sub sta- 
tion designation status in the step SI 8, a step SI 9 
discriminates whether or not its own address is 
45 smaller than the address of the center unit which 
relays the sub station designation status. When the 
discrimination result In the step SI 9 Is YES, a step 
S21 sets a value "1" at the center of the sub 
station direction flag and the process retums to the 
50 step SIS. On the other hand, when the discrimina- 
tion result in the step SI 9 is NO, a step S20 relays 
the sub station designation status and the process 
returns to the step S18. 

On the other hand, when the next received 
65 status is the conference start status in the step 
SI 8, a step S22 relays the conference start status 
and the initial setting ends. 

Accordingly, the master center unit can be set 
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automatically at the start of the video conference, 
and the smooth start of the video conference is 
ensured. 

As a modification of the second embodiment, it 
Is possible to Initially set the station which Invites 
the video conference as the master station and 
initially set the sub station from the master station 
after the tandem connection is made. In addition, 
after the video conference Is started, It is possible 
to connect a new center unit in tandem via a circuit 
and connect additional stations which may partici- 
pate in the video conference. In this case, the 
added stations are initially regarded as participating 
stations. Moreover, in addition to displaying the 
image data from the sub station in the master 
station and displaying the image data from the 
master station in the sub and participating stations, 
it is possible to transmit at the start of the video 
conference still image data from each of the sta- 
tions to all stations which will participate in the 
video conference. In this case, it is possible to 
display the still image data from all stations in each 
station. 

The second embodiment is advantageous es- 
pecially when the video conference must be made 
among distant locations because there is no need 
to directly connect the distant stations and It is 
simply necessary to connect the distant center 
units. As a result, the number of circuits required to 
make the connection for the video conference 
among distant stations is minimized. 

Further, the present invention Is not limited to 
these embodiments, but various variations and 
modifications may be made without departing from 
the scope of the present invention. 

Reference signs have been added to the 
claims for reference purposes only and do not alter 
the scope. 

Claims 

1 . A multi-point conference system for making 
a video conference characterized in that there are 
provided: a center unit (2) including control means 
(46) and image selector means (42); and three or 
more stations (1A-1D) respectively coupled to said 
center unit, each of said stations including at least 
one camera (11-13) for picking up an Image to 
output an Image data, display means (14, 15) for 
displaying an image based on an image data and 
request means (18) for making a request; said 
control means initially setting master, sub and par- 
ticipating stations in conformance with a predeter- 
mined rule; said image selector means automati- 
cally supplying the image data from the master 
station to the sub and participating stations to be 
displayed on the display means thereof and sup- 



plying the image data from the sub station to the 
master station to be displayed on the display 
means thereof: said control means automatically 
setting a new master station in response to a first 

5 request from the request means of an arbitrary 
station requesting the new master station, setting 
the master station prior to receiving the first re- 
quest as a new sub station and setting all stations 
other than the new master and sub stations as new 

10 participating stations. 

2. The multi-point conference system as 
claimed In claim 1 , characterized in that said image 
selector means (42) automatically supplies the im- 
age data from an arbitrary station to the master 

15 station in response to a second request from said 
request means (18) of the master station request- 
ing a display of the image data from said arbitrary 
station, and said control means (46) in response to 
said second request automatically sets said ar- 

20 bitrary station as a new sub station and sets al! 
stations other than the master and the new sub 
stations as new participating stations. 

3. The multi-point conference system as 
claimed in claim 1 or 2, characterized in that said 

25 control means (46) automatically sets a station 
which is newly coupled to said center unit (2) as a 
new participating station. 

4. The multi-point conference system as 
claimed in any of claims 1 to 3. characterized in 

30 that said control means (46) in response to the 
master station disconnecting from said center unit 
(2) automatically sets the sub station as a new 
master station and forcibly sets an arbitrary partici- 
pating station as a new sub station. 

35 5. The multi-point conference system as 
claimed in any of claims 1 to 4. characterized in 
that said control means (46) in response to the sub 
station disconnecting from said center unit (2) for- 
cibly sets an artDitrary participating station as a new 

40 sub station. 

6. The multi-point conference system as 
claimed in any of claims 1 to 5, characterized in 
that said request means (18) includes means (18) 
for manually making a request. 

45 7. The multi-point conference system as 
claimed in any of claims 1 to 6, characterized in 
that each of said stations (1A-1D) include a plurality 
of cameras (11-13), and said request means (18) 
automatically makes said first request when a pre- 

50 determined one (13) of said cameras is selected. 

8. The multi-point conference system as 
claimed in any of claims 1 to 7. characterized in 
that each of said stations (1A-1D) include a micro- 
phone (16) for picking up a sound to output an 

55 audio data and a speaker (17) for outputting a 
sound based on an audio data, and said request 
means (18) automatically makes said first request 
when said microphone picks up the sound continu- 
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ously for a predetermined time. 

9. The multi-point conference system as 
claimed In any of claims 1 to 8, characterized in 
that each of said stations (1A-1D) Include detection 
means (18) for automatically detecting that the 
station is to be regarded as a new master station, 
and said request means (18) automatically makes 
said first request In response to a detection made 
by said detection means. 

10. The multi-point conference system as 
claimed in any of claims 1 to 9, characterized in 
that each of said stations (1A-1D) Include a plurality 
of cameras (11-13), and said control means (46) 
automatically selects the camera to be used in said 
master station and/or sub station based on a re- 
quest from said request means (18). 

11. The multi-point conference system as 
claimed In any of claims 1 to 10, characterized in 
that said control means (46) initially sets the mas- 
ter, sub and participating stations depending on an 
order with which said stations are turned ON so 
that a station turned ON first is set as the master 
station, a station turned ON second Is set as the 
sub station, and one or a plurality of stations turned 
ON thereafter are set as the participating station. 

12. The multi-point conference system as 
claimed In any of claims 1 to 11. characterized In 
that said control means (46) automatically sets a 
new master station In response to the first request 
from the request means (18) of the sub or partici- 
pating station requesting the new master station. 

13. A multi-point conference system for making 
a video conference characterized in that there are 
provided: a plurality of center units (2, 21-24). each 
of said plurality of center units including control 
means (46) and image selector means (42); a plu- 
rality of stations (1, 28-37) respectively coupled to 
each of said center units, each of said stations 
Including at least one camera (11-13) for picking up 
an image to output an image data, display means 
(14, 15) for displaying an image based on an 
image data and request means (18) for making a 
request: and circuits (3. 25-27) which couple said 
center units in a tandem connection; said control 
means initially setting master, sub and participating 
stations depending on an order with which said 
stations are turned ON so that a station turned ON 
first is set as the master station, a station turned 
ON second is set as the sub station and one more 
a plurality of stations tumed ON thereafter are set 
as the participating station; said image selector 
means automatically supplying the image data 
from the master station to the sub and participating 
stations to be displayed on the display means 
thereof and supplying the image data from the sub 
station to the master station to be displayed on the 
display means thereof; said control means auto- 
matically setting a new master station in response 



to a first request from the request means of the 
sub or participating station requesting the new 
master station, setting the master station prior to 
receiving the first request as a new sub station and 
5 setting all stations other than the new master and 
sub stations as new participating stations. 

14. The multi-point conference system as 
claimed In claim 13, characterized in that said 
controller (46) of said center unit (2, 21-24) in- 

10 eludes means (46A, 46B) for Indicating that the 
center unit is a master center unit when the master 
station is coupled thereto and for indicating that the 
center unit is a sub center unit when the sub 
station is coupled thereto, said master center unit 

15 transmitting the image data from the master station 
to one or a plurality of center units which are 
coupled to stations other than the master station, 
said sub center unit transmitting the Image data 
from the sub station to the master station via the 

20 master center unit. 

15. The multi-point conference system as 
claimed in claim 14. characterized in that an ad- 
dress is assigned to each of said center units (2, 
21-24) and said address is transmitted and re- 

25 ceived among said center units, said control means 
(46) initially setting the center unit with a smallest 
address value as the master center unit and the 
center unit with a second smallest address value as 
the sub center unit by comparing the address of 

30 the center unit witii the addresses of other center 
units. 

16. The multi-point conference system as 
claimed in claim 14 or 15, characterized in that 
said image selector means (42) automatically sup- 

35 plies the image data from an arbitrary station to the 
master station in response to a second request 
from said request means (18) of the master station 
requesting a display of the Image data from said 
arbitrary station, and said control means (46) in 

40 response to said second request automatically sets 
said arbitrary station as a new sub station and sets 
all stations otiier than the master and tiie new sub 
stations'as new participating stations. 

17. The multi-point conference system as 
45 claimed in any of claims 14 to 16, characterized in 

that said control means (46) automatically sets a 
station which Is newly coupled to said center unit 
(2, 21-24) as a new participating station, 

18. The multi-point conference system as 
50 claimed in any of claims 14 to 16. characterized in 

that said control means (46) in response to the 
master station disconnecting from said center unit 
(2, 21-24) automatically sets the sub station as a 
new master station and forcibly sets an arbitrary 
55 participating station as a new sub station. 

19. The multi-point conference system as 
claimed In any of claims 14 to 18. characterized in 
that said control means (46) in response to tiie sub 
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station disconnecting from said center unit (2, 21- 
24) forcibly sets an arbitrary participating station as 
a new sub station. 

20. The multi-point conference system as 
claimed in any of claims 14 to 19. characterized in 6 
that said request means (18) includes means (18) 

for manually making a request. 

21. The multi-point conference system as 
claimed in any of claims 14 to 20. characterized in 

that each of said stations (1. 28-37) include a io 
plurality of cameras (11-13). and said request 
means (18) automatically makes said first request 
when a predetermined one (13) of said cameras is 
selected. 

22. The multi-point conference system as 15 
claimed in any of claims 14 to 21, characterized in 

that each of said stations (1, 28-37) Include a 
microphone (16) for picking up a sound to output 
an audio data and a speaker (17) for outputting a 
sound based on an audio data, and said request 20 
means (18) automatically makes said first request 
when said microphone picks up the sound continu- 
ously for a predetermined time. 

23. The' multi-point conference system as 
claimed in any of claims 14 to 22, characterized in 2s 
that each of said stations (1, 28-37) include detec- 
tion means (18) for automatically detecting that the 
station is to be regarded as a new master station. 

and said request means (18) automatically makes 
said first request In response to a detection made 30 
by said detection means. 

24. The multi-point conference system as 
claimed in any of claims 14 to 23. characterized in 
that each of said stations (1, 28-37) include a 
plurality of cameras (11-13). and said control 35 
means (46) automatically selects the camera to be 
used in said master station and/or sub station 
based on a request from said request means (18). 

25. The multi-point conference system as 
claimed in any of claims 13 to 24, characterized in 40 
that said control means (46) initially sets the mas- 
ter, sub and participating stations depending on an 
order with which said stations are turned ON so 

that a station turned ON first is set as the master 
station, a station turned ON second is set as the . 46 
sub station, and one or a plurality of stations turned 
ON thereafter are set as the participating station. 

26. The multi-point conference system as 
claimed in any of claims 13 to 25. characterized in 

that said control means (46) automatically sets a so 
new master station in response to the first request 
from the request means (18) of the sub or partici- 
pating station requesting the new master station. 

55 
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